Optical apparatus with unit for correcting blur of captured image caused by displacement of optical apparatus in optical-axis direction

ABSTRACT

A focus range is determined on the basis of an object distance, focal distance, and aperture value, after an autofocus operation. When SW2 is operated, an exposure is performed only during a period that a displacement of a blur in an optical-axis direction is within the focus range. If an exposure time for one exposure does not reach an exposure time to obtain an optimum exposure, a plurality of exposures are performed until a total exposure time reaches the exposure time to obtain the optimum exposure. When the plurality of exposures are performed, a plurality of images obtained are combined to generate an image with the optimum exposure.

The present application is a divisional of U.S. patent application Ser.No. 11/957,263, filed Dec. 14, 2007, entitled “OPTICAL APPARATUS WITHUNIT FOR CORRECTING BLUR OF CAPTURED IMAGE CAUSED BY DISPLACEMENT OFOPTICAL APPARATUS IN OPTICAL-AXIS DIRECTION”, the content of which isexpressly incorporated by reference herein in its entirety. Further, thepresent application claims priority from Japanese Patent Application No.2006-343430, filed Dec. 20, 2006, which is also hereby incorporated byreference herein in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a technique of improving deteriorationof a captured image caused by hand shake during image captured by anoptical apparatus such as a digital camera. In particular, the presentinvention relates to a technique of reducing image blurring caused, forexample, by hand movement in the optical-axis direction during macroimage-capturing.

2. Description of the Related Art

An optical apparatus such as a camera or an interchangeable lens isoften provided with an image stabilizer that improves an image blurcaused by hand-induced shake or the like.

The hand-induced shake is a vibration normally having a frequencyranging from 1 to 10 Hz. The image stabilizer mainly corrects imageblurring caused by vibrations having such a frequency. For imagestabilization, the vibration of the optical apparatus is detected. Then,a technique like optical image-stabilization or electronicimage-stabilization is used. Optical image-stabilization shifts acorrection lens in a plane orthogonal to the optical axis in accordancewith the detected vibration. The electronic image-stabilization variesan area, from which data is output as an image, from within the totalpixel area of the imaging element.

If the image-capturing magnification is 0.1 or lower, in general, imageblurring can be reliably corrected only by correcting an angular blur ina direction in which the image pickup surface tilts. If theimage-capturing magnification is higher than 0.1, the effect of blurringin a parallel direction, i.e., in vertical and horizontal directions(hereinafter, referred to as a shift blur), and the effect of blurringin the optical-axis direction (hereinafter, referred to as a focus blur)may increase. FIG. 1 is a graph showing the effects of the blurs. FIG. 1plots image-capturing magnification in the x direction and displacementof the image in an image plane due to blurring in the y direction.

To improve (i.e. reduce) the blurs in an optical apparatus having a highimage-capturing magnification such as a macro lens, a technique has beenproposed that detects a shift blur and a focus blur with an accelerationsensor or the like, and drives and controls a correction system on thebasis of the detection output (see Japanese Patent Laid-Open No.09-080523).

The above-mentioned electronic image-stabilization is frequently used inapparatus for recording movies, such as a video camera.

In the field of still images, a technique has been proposed in which aplurality of underexposure images are captured at a shutter speed whichis hardly affected by hand shake, positional shifts among the images arethen corrected, and the images are combined, so as to reduce theblurring and obtain a still image with an optimum exposure (see JapanesePatent No. 03110797).

With the above technique, since the positional shifts among the imagescan be acquired using the captured images, a blur detection element suchas a vibrating gyroscope is not necessary. Also, since the correction isperformed on the basis of a blur signal from the image pickup surface,the above-mentioned shift blur and angular blur do not have to beconsidered separately.

With both techniques described above, the angular blur and shift blurcan be reliably corrected.

However, with the technique of Japanese Patent Laid-Open No. 09-080523,the focus lens is moved in an optical-axis direction to correct thefocus blur, causing the following problems.

First, as the focus lens is moved in the optical-axis direction, theangle of field is changed. This is one of the important factors of thedeterioration in images when high magnification image-capture such asmacro image-capture is performed. If a lens for correcting the angle offield is additionally provided for preventing the deterioration inimages, the correction system may become complicated. Further, anexisting focus lens driving system for auto-focusing cannot accuratelyfollow the blur because the driving characteristic of a motor isinsufficient and the backlash is large. While the technique of JapanesePatent No. 03110797 is effective for a shift blur, the patent does notdisclose nor suggest correction of a focus blur.

SUMMARY OF THE INVENTION

The present invention can provide an optical apparatus capable ofproviding an image having reduced focus blurring caused by hand-inducedshake without using an auto-focusing device or a mechanical device foraccurately following the blur.

According to an aspect of the present invention an optical apparatus isprovided with a lens system having a focus lens and an image pickupelement which converts an image formed by the lens system into an imagesignal. Such an optical apparatus includes a control unit configured tocontrol operation of the apparatus, an auto-focus unit configured tomove the focus lens to bring the image into an in-focus state, adisplacement detection unit configured to detect a displacement of theoptical apparatus in the direction of the optical axis of the lenssystem, and a focus-range setting unit configured to calculate anacceptable range of detected displacement within which it is assumedthat the image remains in an in-focus state. The control unit isoperable to capture one or more images in a given time period from thepickup element when the detected displacement is within said acceptablerange.

With this aspect of the present invention, a more focused image can beobtained even if a blur in the optical-axis direction seriously affectsthe image captured.

Another embodiment of the present invention provides an opticalapparatus including a taking lens unit arranged to have a focus lens.The apparatus may include an image pickup element including an imagepickup element, the image pickup element being arranged to pick up anobject image focused on the image pickup element and convert the objectimage into an image signal; an autofocus unit configured to drive thefocus lens to bring the object image on the image pickup element into anin-focus state; an image pickup control unit configured to startimage-capturing an object in response to an operation of an image pickupstart switch, and to perform control for obtaining the image signal fromthe image pickup element; a displacement detection unit arranged tooutput a displacement signal of the optical apparatus in an optical-axisdirection; a memory arranged to store an output of the displacementdetection unit when the object image is brought into the in-focus statewith the autofocus unit; a focus-range setting unit configured to set afocus range within which the object image is assumed to be in-focusaccordance with a condition of the taking lens unit, even if the opticalapparatus is displaced in the optical-axis direction; and an in-focusstate judgment unit configured to judge whether the detecteddisplacement is within the set focus range, in which the image pickupcontrol unit controls the image pickup element in accordance with ajudgment result of the in-focus state judgment unit, and obtains aplurality of the converted image signals.

With this aspect of the present invention, the image pickup control unitcan control the image pickup element if the judgment result of thein-focus state judgment unit is within the focus range, controls theimage pickup element, and obtains an image signal within the focusrange.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a graph showing effects of image-capturing magnifications andmotion blurs caused by hand shake to an image plane.

FIG. 2 is a block diagram showing the function of a digital single-lensreflex camera with an interchangeable lens according to a firstembodiment of the present invention.

FIG. 3 is a first graph showing the relationship between blur in anoptical-axis direction and exposure according to the first embodiment ofthe present invention.

FIG. 4 is a second graph showing the relationship between blur in theoptical-axis direction and the exposure according to the firstembodiment of the present invention.

FIG. 5 is an illustration schematically showing image combiningaccording to the first embodiment of the present invention.

FIG. 6 is a flowchart showing an operation of the first embodiment ofthe present invention.

FIG. 7 is a flowchart showing an operation of unfocused state processing1 according to the first embodiment of the present invention.

FIG. 8 is a flowchart showing an operation of unfocused state processing2 according to the first embodiment of the present invention.

FIG. 9 is a flowchart showing an operation of unfocused state processing3 according to the first embodiment of the present invention.

FIG. 10 is a block diagram showing the function of a digital single-lensreflex camera with an interchangeable lens according to a secondembodiment of the present invention.

FIG. 11 is a block diagram schematically showing a way to obtain thedisplacement of a blur in an optical-axis direction according to thesecond embodiment of the present invention.

FIG. 12 is an illustration schematically showing image combiningaccording to the second embodiment of the present invention.

FIG. 13 is a flowchart showing an operation of the second embodiment ofthe present invention.

DESCRIPTION OF THE EMBODIMENTS

Embodiments of the present invention are now described with reference tothe attached drawings.

First Embodiment

FIG. 2 is a block diagram showing the function of a digital single-lensreflex camera with an interchangeable lens. The camera is an opticalapparatus according to a first embodiment of the present invention.

An acceleration sensor 1 detects the acceleration of the camera in anoptical-axis direction. A displacement calculation portion 3 calculatesthe displacement of the blur in the optical-axis direction by applyingsecond-order integration to a signal obtained such that an output of theacceleration sensor 1 is subtracted by a direct-current (DC) component(i.e., electrical DC offset and DC component caused by acceleration dueto gravity).

A release switch 4 can be half pressed (SW1) or fully pressed (SW2). Ashutter speed setting portion 5 sets the shutter speed when the releaseswitch 4 is half pressed (SW1). An aperture stop setting portion 6 setsthe aperture value.

A focal position detection portion 7 detects a focused position of anobject. An autofocus (AF) control portion 8 controls an AF operation. Afocus unit 9 includes a focus lens and a motor, and serves as anautofocus unit. A focal length detection portion 10 detects a currentfocal length on the basis of the position of a zoom lens.

A storage portion 11 stores an output of the displacement calculationportion 3 in the in-focus state. A focus-range setting portion 12 sets afocus range within which an object is assumed to be in an in-focus stateeven if the camera is moved in the optical-axis direction due to handshake. The range can be set on the basis of the focal length, an objectdistance obtained on the basis of the position of the focus lens in thein-focus state, and the aperture value set with the aperture stopsetting portion 6. An in-focus state judgment portion 13 judges whetherthe displacement obtained such that the output of the displacementcalculation portion 3 is subtracted by an output of the storage portion11, is within the focus range set with the focus-range setting portion12.

An exposure control portion 14 allows an exposure to be performed duringa period that an object is judged with the in-focus state judgmentportion 13 as in an in-focus state when the release switch 4 is fullypressed (SW2). When the in-focus state judgment portion 13 judges thatthe object is in an unfocused state during the exposure, or when theexposure is continued for a predetermined exposure time set with theshutter speed setting portion 5, the exposure control portion 14 stopsor completes the exposure.

An image pickup portion 15 converts the image signal into an electricsignal, a signal processing portion 16 acquires the converted imagesignal as electronic data, and an image storage portion 17 temporarilystores the electronic data, in accordance with a control signal of theexposure control portion 14.

An image combination portion 19, in a case where the image storageportion 17 temporarily stores a plurality of images, combines theseimages and generates a single output image.

An image recording portion 20 stores the image generated with the imagecombination portion 19 or an image stored in the image storage portion17 if a single image is stored, in a nonvolatile storage device.

Next, the relationship between a blur in the optical-axis direction andthe exposure is described with reference to FIGS. 3 and 4.

FIG. 3 plots time in the x direction and displacement in theoptical-axis direction in the y direction. It is assumed that the AFoperation of the focus unit 9 is completed at the time indicated by thedotted line in FIG. 3, and an object is brought into an in-focus stateat that point. The storage portion 11 stores the displacement in theoptical-axis direction in the in-focus state.

At the time when the object is brought into the in-focus state, anobject distance is determined on the basis of the position of the focuslens. The focus-range setting portion 12 determines a focus range withinwhich an object is assumed to be in an in-focus state on the basis of acurrently focused position, in accordance with the object distance, theaperture value determined with the aperture stop setting portion 6, andthe current focal length. The focus range is similar to the depth offield, however, is not equivalent thereto. Regarding a time lag or thelike for the start or completion of the exposure, it is desirable thatthe focus range is smaller than the depth of field. To preventchattering from occurring during the start or completion of theexposure, a hysteresis may be applied to a value of displacement at thestart or completion of the exposure within the focus range.

FIG. 4 is similar to FIG. 3 and plots time in the x direction anddisplacement in the optical-axis direction in the y direction. Thedisplacement in the optical-axis direction is subtracted by thedisplacement in the in-focus state stored in the storage portion 11,namely by an offset, and the value is displayed. In FIG. 4, a rangeindicated with an arrow and a name of “focus range” is the focus rangeset with the focus-range setting portion 12. When the release switch 4is full pressed (SW2) at the time indicated by the dotted-chain line,the exposure is performed only while the displacement is within thefocus range, or only during periods indicated by oblique lines in FIG.4.

FIG. 5 is an illustration showing an operation of combining imagesobtained by three exposures as shown in FIG. 4, and generating a singleimage. The exposure control portion 14 determines the number ofexposures. The exposures are performed until the total exposure timereaches a predetermined exposure time set with the shutter speed settingportion 5. However, when the in-focus state judgment portion 13 judgesthat the unfocused state is continued for a given time or more, adifferent operation is performed. The details of the operation will bedescribed later.

FIG. 6 is a flowchart showing the operation of this embodiment. When auser half presses the release switch 4 so as to focus on an object(S002), the focal position detection portion 7 detects the focal point.On the basis of the result of the focal point detection, the AF controlportion 8 drives an AF motor disposed in the focus unit 9, so that thelens is stopped at a target focus position. Then, the focal positiondetection portion 7 detects a focal point again. When it is detectedthat focal point is in the in-focus state, the AF processing iscompleted (S003).

Then, the storage portion 11 stores an output of the displacementcalculation portion 3 at the completion of the AF processing (S004).Also, the focus-range setting portion 12 determines the focus rangewithin which an object is assumed to be in an in-focus state, on thebasis of the object distance, focal length and aperture value, which areoptical information at the completion of the AF processing (S005).

When the user fully presses the release switch 4 (S006), the in-focusstate judgment portion 13 judges whether the object is currently in thein-focus state (S007). The judgment is made because the object may be inan unfocused state when the camera is moved in the optical-axisdirection due to hand shake occurring in a period after the AFprocessing is completed until the operation of SW2, even if the objecthas been focused by the AF processing.

If the object is in the unfocused state, it is judged whether theunfocused state has been continued for a given time or more (S014). Ifthe unfocused state has not been continued for the given time or more,the processing returns to step 5007 and the judgment is made again. Ifthe unfocused sate has been continued for the given time or more, theprocessing goes to unfocused state processing. The details of theprocessing will be described later.

If it is judged that the object is in the in-focus state in step 5007, amirror is moved up and a shutter is opened to start an exposure (S008).The in-focus state judgment portion 13 judges whether the object is inthe in-focus state during the exposure (S009). If the in-focus state iscontinued, it is judged whether the exposure time has reached thepredetermined exposure time set with the shutter speed setting portion 5(S012). The exposure is continued if the exposure has not yet reachedthe predetermined exposure time, whereas the mirror is moved down andthe shutter is closed to complete the exposure if the exposure has beencontinued for the predetermined exposure time (S013).

If it is determined that the object is “out of the focus range” in step5009, the exposure is completed (S010). Then, it is judged whether theexposure time has reached the predetermined exposure time set with theshutter speed setting portion 5 (S011). If the exposure time has notreached the predetermined exposure time, the processing returns to step5007.

If the total counted exposure time reaches the predetermined exposuretime set with the shutter speed setting portion 5, or if the unfocusedstate processing is finished, it is judged whether a plurality of imageshave been acquired by a single operation of SW2 in step 5016. The imagestorage portion 17 temporarily stores the acquired images.

If the image stored in the image storage portion 17 is only a singleimage, the processing goes to step 5018, and the image recording portion20 stores the image in the nonvolatile storage device.

If it is judged that the image stored in the image storage portion 17 isa plurality of images in step 5016, the processing goes to step 5017,and the image combination portion 19 combines the images. Each of theplurality of images is an image with an underexposure. Combining theplurality of images can generate an image with an optimum exposure. Theimage recording portion 20 stores the image generated in step 5017 inthe nonvolatile storage device (S018). After the processing of step 5018is finished, the image temporarily stored in the image storage portion17 is deleted.

FIGS. 7 to 9 are flowcharts showing unfocused state processing. If it isdetermined that the unfocused state has been continued for the giventime or more in step 5014 of FIG. 6, unfocused state processing in oneof FIGS. 7 to 9 is performed.

In unfocused state processing 1 illustrated by the flowchart in FIG. 7,if the unfocused state has been continued for the given time or more,the focus lens is driven in a direction corresponding to the output ofthe displacement calculation portion 3, and starts an exposure at thetime when the object is in the in-focus state. Hereinafter, theprocessing is described in time series.

Once the unfocused state processing 1 is started, it is judged whetherthe image storage portion 17 has temporarily stored the image during aperiod between the operation of SW2 and the beginning of the processing(S102). If no image has been temporarily stored, the processing goes tostep S104.

If an image has been temporarily stored, the temporarily stored image inthe image storage portion 17 is deleted (S103), and the processing goesto step S104.

In step S104, the focus lens is driven by an amount corresponding to alens driving amount calculated on the basis of the output of thedisplacement calculation portion 3. The output of the displacementcalculation portion 3 represents a shift between the position of thecamera focused with the operation of SW1 and the current position.

Thus, the driving amount of the focus lens to be moved can be calculatedusing the output of the displacement calculation portion 3, so that theobject is again in the in-focus state.

In step S104, the storage portion 11 stores the output of thedisplacement calculation portion 3 at the time when driving of the lensis completed (S105). Also, the focus-range setting portion 12 determinesthe focus range within which the object is assumed to be in the in-focusstate, on the basis of the object distance, focal length and aperturevalue, which are optical information at this time (S106).

While the focus-range setting portion 12 determines the focus rangewithin which the object is assumed to be in the in-focus state on thebasis of the three pieces of optical information of the object distance,focal length and aperture value in this embodiment, the focus-rangesetting portion 12 can determine the focus range within which the objectis assumed to be in the in-focus state on the basis of other pieces ofinformation such as an angle of field.

At the time when the above step is completed, the object is in anin-focus state, and hence, an exposure is started (S107). The in-focusstate judgment portion 13 continues to determine the existence of thein-focus state during the exposure (S108). If the in-focus statecontinues, it is determined whether the exposure time has reached thepredetermined exposure time set with the shutter speed setting portion 5(S111). The exposure is continued if the exposure has not been continuedfor the predetermined exposure time, whereas the exposure is completedif the exposure has been continued for the predetermined exposure time(S112). After the exposure is completed, the processing returns to stepS106, and it is judged whether a plurality of images has been acquiredwith the single operation of SW2.

The exposure is completed if it is determined that the object is out ofthe focus range in step S108 (S109), and it is judged whether theexposure time has reached the predetermined exposure time set with theshutter speed setting portion 5 (S110). If the exposure time has reachedthe predetermined exposure time, the processing goes to step S114, andthe judgment for the in-focus state is performed. If the object iswithin the focus range again, the exposure is started again (S107).

If the object is out of the focus range, it is judged whether theunfocused state has been continued for a given time (S115). If theunfocused state has been continued for the given time, the processingreturns to step S114, and the judgment for the in-focus state isperformed. If the unfocused sate has not been continued for the giventime, the unfocused state processing 2 or 3 is performed (S116). Notethat the given time may be equivalent to the time used in step S104 inFIG. 6, or may be a different time.

In the unfocused state processing 2 illustrated with the flowchart inFIG. 8, if the unfocused state has been continued for a given time ormore, the sensitivity (ISO speed rate) of the acquired image isincreased to compensate for underexposure of the image.

Once the unfocused state processing 2 is started, it is judged whetherthe image storage portion 17 has temporarily stored the image during aperiod between the ON operation of SW2 and the beginning of theprocessing (S202). If an image has been temporarily stored, theprocessing goes to step S203. If no image has been temporarily stored,the unfocused state processing 1 or 3 is performed.

In step S203, if only a single image has been stored in the imagestorage portion 17, the sensitivity of the image is adjusted to have anoptimum brightness. If a plurality of images have been stored, theimages are combined into a single image, and then the sensitivity of theimage is adjusted to have an optimum brightness.

In the unfocused state processing 3 illustrated with the flowchart inFIG. 9, an exposure is started immediately when the unfocused state hasbeen continued for a given time or more, and is continued until theexposure time reaches a predetermined exposure time.

Once the unfocused state processing 3 is started, an exposure isimmediately started (S302), is continued until the exposure time reachesa predetermined exposure time set with the shutter speed setting portion5 (S303), and when the exposure time reaches the predetermined exposuretime, the exposure is completed (S304).

With this embodiment, an image in focus can be obtained even if a blurin the optical-axis direction seriously affects the image captured.

If the in-focus state has not been continued for a given time, theunfocused state processing 3 performs exposure even in the unfocusedstate. Hence, an image, though having a blur, can be captured. Theunfocused state processing 3 prevents unavailability of an image in anin-focus state from being continued.

Also, an underexposure can be compensated by combining images ifnecessary. A highly accurate mechanism for correcting a focus blur isnot necessary, and hence, the camera can be prevented from beingincreased in size and cost, and from having a complicated structure.

Further, a blur in a direction orthogonal to the optical axis can bereliably corrected by utilizing both optical image-stabilization andelectronic image-stabilization.

Second Embodiment

In the above-described first embodiment, the acceleration sensor is usedfor detection of a focus blur. Also, a blur correction function isarranged for correcting a blur in the direction orthogonal to theoptical axis.

In a second embodiment, an acceleration sensor and an angular speedsensor are used for detection of a focus blur. Also, a motion bluroptical correction unit and a motion blur electronic correction unit arearranged for correcting a blur in the direction orthogonal to theoptical axis.

The second embodiment is described with reference to FIGS. 10 to 13.Like numerals refer like components as in the first embodiment. Also,descriptions of operations similar to those of the first embodiment areomitted. Operations unique to the second embodiment are mainlydescribed.

FIG. 10 is a block diagram showing the function of a digital single-lensreflex camera with an interchangeable lens, the camera which is anoptical apparatus according to the second embodiment of the presentinvention.

An acceleration sensor 1 and an angular speed sensor 2 detect anacceleration and an angular speed of a blur in the optical-axisdirection. The displacement calculation portion 3 obtains a displacementof a blur in the optical-axis direction on the basis of outputs of theacceleration sensor 1 and angular speed sensor 2.

FIG. 11 is a block diagram showing a way to obtain the displacement. Theoutput of the acceleration sensor 1 is passed through a high pass filter101, so as to eliminate an electrical DC component and a steadyacceleration component of gravity.

The output of the angular speed sensor 2 is applied to an integrator102, and a slight displacement in a direction of the acceleration ofgravity is obtained using the output integrated value. A multiplier 104multiplies the displacement by a predetermined value (K), and asubtracter 103 subtracts the acceleration after passing through the highpass filter 101 by the multiplied value. In this way, an accelerationfrom which the acceleration component of gravity was completelyeliminated can be obtained. Then, integrators 105 and 106 applysecond-order integration to the obtained acceleration, to obtain adisplacement 107 of a blur in the optical-axis direction.

Referring back to FIG. 10, an angular speed sensor 21 detects an angularspeed in the direction orthogonal to the optical axis, in a pitchdirection, and in a yaw direction. A shift blur angle calculationportion 22 eliminates a DC component from an output of the angular speedsensor 21, and integrates the output, to calculate an angle of a blur inthe direction orthogonal to the optical axis.

A shift blur control portion 23 outputs a driving signal to a shift blurcorrection unit 24 corresponding to a signal from the shift blur anglecalculation portion 22. The shift blur correction unit 24 drives acorrection lens corresponding to the driving signal from a shift blurcontrol portion 23, to correct an angular blur in the directionorthogonal to the optical-axis direction.

An image position correction portion 18 corrects positional shifts amongimages if the image temporarily stored in the image storage portion 17is a plurality of images.

FIG. 12 schematically illustrates image combining. It is assumed thatthree images (a), (b), and (c) are obtained with the operation of SW2.As described above, the camera of the second embodiment has the motionblur optical correction unit configured to correct an angular blur inthe direction orthogonal to the optical axis. However, an angular blurmay be still remained because it is not sufficiently corrected, or theposition of an object may be slightly shifted in the images because of ashift blur. If these images are simply combined, the combined objectimage may blur as shown in part (d) of FIG. 12. To avoid this, the imageposition correction portion 18 corrects the positional shifts among theplurality of images. With this correction, a combined image withminimized blur can be obtained as shown in part (e) of FIG. 12.

FIG. 13 is a flowchart showing an operation of the second embodiment.Steps similar to those of the flowchart in FIG. 6 showing the operationof the first embodiment refer step numbers similar thereto.

When a user half presses the release switch 4 (S002), correction of ashift blur is started (S020). The focal position detection portion 7detects a focal point, and the AF control portion 8 drives the AF motordisposed in the focus unit 9 accordingly.

The AF motor drives the focus lens, and the lens is stopped at a targetposition so that the object is in the in-focus state. The focal positiondetection portion 7 detects a focal point again, and if the focal pointis in the in-focus state, the AF processing is completed (S003).

Then, an image-capturing magnification is obtained on the basis of theposition of the focus lens determined by the AF processing, and it isjudged whether current image-capturing is macro image-capture or not, onthe basis of the obtained image-capturing magnification (S021).

If the macro image-capturing is not performed, normal image-capturing isperformed which is not particularly described in this specification(S022). The image recording portion 20 stores the captured image in thenonvolatile storage device (S018).

If it is judged that macro image-capture is performed in step 5021, thestorage portion 11 stores an output of the displacement calculationportion 3 at the completion of the AF processing (S004).

Also, the focus-range setting portion 12 determines the focus rangewithin which the object is assumed to be in the in-focus state, on thebasis of the object distance, focal length and aperture value, which areoptical information at the completion of the AF processing (S005).

When the user fully presses the release switch 4 (S006), the in-focusstate judgment portion 13 judges whether an object is currently in thein-focus state (S007).

If the object is not judged as in the in-focus state, it is judgedwhether the unfocused state has been continued for a given time or more(S014). If the unfocused state has not been continued for the given timeor more, the processing returns to the step 5007 and the judgment ismade again.

If the unfocused state has been continued for the given time or more,the processing goes to unfocused state processing. If it is judged thatthe object is in the in-focus state in step 5007, an exposure is started(a mirror is moved up and a shutter is opened) (S008).

The in-focus state judgment portion 13 judges whether the object is inthe in-focus state during the exposure (S009). If the in-focus state iscontinued, it is judged whether the exposure time has reached apredetermined exposure time set with the shutter speed setting portion 5(S012).

The exposure is continued if the exposure has not been continued for theexposure time, whereas the exposure is completed (the mirror is moveddown and the shutter is closed) if the exposure has been continued forthe predetermined exposure time (S013).

If it is determined that the object is not within the focus range instep 5009, the exposure is completed (the mirror is moved down and theshutter is closed) (S010). Then, it is judged whether the exposure timehas reached the predetermined exposure time set with the shutter speedsetting portion 5 (S011). If the exposure time has not reached thepredetermined exposure time, the processing returns to step 5007.

If the total counted exposure time reaches the predetermined exposuretime set with the shutter speed setting portion 5, or if the unfocusedstate processing is finished, it is judged in step 5016 whether aplurality of images have been acquired by a single operation of SW2. Theimage storage portion 17 temporarily stores the acquired images.

If the image stored in the image storage portion 17 is only a singleimage, the processing goes to step 5018, and the image recording portion20 stores the image in the nonvolatile storage device.

If it is judged that the image stored in the image storage portion 17 isa plurality of images in step 5016, the processing goes to step 5023,and the image position correction portion 18 corrects positional shiftsamong the images.

Then, the image combination portion 19 combines the images with thepositional shifts corrected (S017). The image recording portion 20stores the image generated in step 5017, in the nonvolatile storagedevice (S018). After the processing of step 5018 is completed, the imagetemporarily stored in the image storage portion 17 is deleted.

Unfocused state processing is similar to that of the first embodiment,and the description thereof is omitted. The embodiments of the presentinvention are described above, however, the present invention is notlimited thereto and various modifications can be made.

For example, the mirror may not be moved up and down when the exposureis started and completed. The mirror may be moved up in response to theoperation of SW2, and the mirror may be moved down when image-capturingis completed. As an alternative a half silvered mirror which does notmove may be used.

The motion blur optical correction unit does not have to be used forcorrecting the angular blur in the direction orthogonal to the opticalaxis: the motion blur electronic correction unit may be used by itself.

The motion blur electronic correction unit does not have to be used forcorrecting the shift blur. The shift blur may be corrected with themotion blur optical correction unit only, as long as the accelerationsensor or the like detects the shift blur.

The determination of the macro image-capture may not only rely upon theimage-capturing magnification during image-capturing. A macro modeswitch or the like may be provided, so that the user can select themacro mode.

The unfocused state processing can be possibly performed in five ways asfollows. Either one of the five ways can be performed, or an optimum onecan be selected depending on an image-capturing condition such as ashutter speed, or an image-capturing mode.

1) Perform the unfocused state processing 1, the unfocused stateprocessing 2, and the unfocused state processing 3 in sequence.

2) Perform the unfocused state processing 2, the unfocused stateprocessing 1, and the unfocused state processing 3 in sequence.

3) Perform the unfocused state processing 1 and the unfocused stateprocessing 3 in sequence.

4) Perform the unfocused state processing 2 and the unfocused stateprocessing 3 in sequence.

5) Perform only the unfocused state processing 3.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications, equivalent structures and functions.

1. An optical apparatus including a lens system having a focus lens andan image pickup element which converts an image formed by the lenssystem into an image signal, the apparatus comprising: a control unitconfigured to control operation of the apparatus; an auto-focus unitconfigured to move the focus lens to bring the image into an in-focusstate; a displacement detection unit configured to detect a displacementof the optical apparatus in the direction of the optical axis of thelens system; and a focus-range setting unit configured to calculate anacceptable range of detected displacement within which it is assumedthat the image remains in an in-focus state, wherein the control unit isoperable to capture one or more images in a given time period from thepickup element only when the detected displacement is within saidacceptable range.
 2. The optical apparatus according to claim 1, whereinthe focus-range setting unit is operable to calculate an acceptablerange of detected displacement based on one or more of the parameters:aperture size, focal length, and the position of the object to becaptured.
 3. The optical apparatus according to claim 1, furthercomprising: an image pickup time setting unit operable to set apredetermined total image pickup time corresponding to one or more ofthe parameters: aperture size, focal length, and the position of theobject to be captured; and an image combination unit configured tocombine the plurality of the image signals obtained with the imagepickup element, wherein the image pickup element is operable to pick upa plurality of object images until a total image pickup time controlledwith the control unit reaches the predetermined total image pickup timeset with the image pickup time setting unit, and the image combinationunit is operable to combine the plurality of image signals obtained withthe image pickup element and to generate a single image.
 4. The opticalapparatus according to claim 1, wherein the control unit is operable, ifthe output of the displacement detection unit is not within theacceptable range for a predetermined time after an image pickup startswitch is operated, to cause the focus lens to be driven to a positionwhere the focus lens is focused on the object on the basis of the outputof the displacement detection unit.
 5. The optical apparatus accordingto claim 1, wherein the control unit is operable, if the output of thedisplacement detection unit is not within the acceptable range for apredetermined time and if the image pickup element has acquired at leastone image after an image pickup start switch is operated, to cause thesensitivity of the apparatus to be increased to obtain a single image.6. The optical apparatus according to claim 1, wherein the control unitis operable, if the output of the displacement detection unit is out ofthe acceptable range for a predetermined time after an image pickupstart switch is operated, to cause the image pickup element to startpicking up an image, and to continue an exposure until the elapsed imagepickup time reaches a predetermined total image pickup time set by theimage pickup time setting unit.